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DETAILED ACTION 

1. This action is responsive to communications: Amendment, filed on 3/22/2007. 
This action is final. 

2. Claims 2-5, 7 and 9-10 are pending in this application. Claims 3 and 9 are 
independent claims. In the Amendment, filed on 3/22/2007, claims 3 and 9 were 
amended. 

3. The present title of the invention is "Method and system for presenting three- 
dimensional computer graphics images using multiple graphics processing units" as 
filed originally. 

Claim Rejections - 35 USC § 103 

4. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

5. Claims 2-5, 7 and 9-10 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Knittel et al. (6,532,017) and further in view of Kaufman et al. 
(5,760,781). 

6. As per claim 3, Knittel et al. (6,532,017), hereinafter Knittel, discloses a method 
for presenting three-dimensional computer graphics images using multiple graphics 
processing units, comprising the steps of: 

(1) allocating, to the multiple graphics processing units, a set of three- 
dimensional computer graphics data such that said allocated set of three-dimensional 
computer graphics data corresponds to substantially all of a scene that lies within 
rectangular subvolumes to which the multiple graphics processing units have been 
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assigned (Figure 7 V-Bus to 210 "The VRC 202 includes a pipelined processing 
element 210 having 4 parallel rendering pipelines 212 ... The processing element 210 
obtains voxel data from the voxel memory 100 via voxel memory interface logic 216", 
column 14, line 61-63, where the rendering pipelines are the graphics processing units); 

(2) determining a viewing position, wherein said determined viewing position 
determines an aspect of said allocated set of three-dimensional computer graphics data 
to be rendered (Figure 1 where the view direction determines a viewing position); and 

(3) communicating said determined viewing position to the multiple graphics 
processing units ("All of the calculations for data positions having a given x coefficient 
modulo 4 are processed by the same rendering pipeline", column 15, line 11-16); 

(4) rendering, by the multiple graphics processing units, substantially all of said 
allocated set of three-dimensional computer graphics data (where each pipeline can 
perform "interpolation, classification, gradient estimation, illumination, and compositing", 
Abstract); 

(5) combining said rendered set of three-dimensional computer graphics data 
with image combiners (Figure 4 29 "the colors, levels of brightness, and transparencies 
assigned to all of the samples along all of the rays are applied as illustrated at 29 to a 
compositing unit 124 that mathematically combines the sample values into pixels 
depicting the resulting image 32 for display on image plane 16", column 9, line 34-40, 
where the compositing unit is considered combiner), wherein outputs from the multiple 
graphics processing units are direct inputs to first stage image combiners and outputs 
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from at least two of the first stage image combiners are direct inputs to a second stage 
image combiner, thereby producing a three-dimensional computer graphics image; and 

(6) presenting, for viewing, said combined three-dimensional computer graphics 
image (Figure 4, item 32). 

Knittel discloses a method for presenting three-dimensional computer graphics 
images using multiple graphics processing units. It is noted that Knittel does not 
explicitly disclose "outputs from the multiple graphics processing units are direct inputs 
to first stage image combiners and outputs from at least two of the first stage image 
combiners are direct inputs to a second stage image combiner, thereby producing a 
three-dimensional computer graphics image", however, this is known in the art as taught 
by Kaufman et al., hereafter Kaufman. Kaufman discloses a method of volume 
visualization in which the voxel data is combined hierarchically (Figure 6 where voxel 
combination unit 38 is considered an image combiner and a voxel is considered a 
subvolume of a image). 

Thus, it would have been obvious to one of ordinary skill in the art to incorporate 
the teaching of Kaufman into Knittel because Knittel discloses a method of presenting 
three-dimensional computer graphics and Kaufman discloses the image is combined in 
several stages in order to quickly generate a three-dimensional image. 
7. As per claim 2, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 3, and Knittel further discloses loading, into memory cells 
accessible by the multiple graphics processing units, the set of three-dimensional 
computer graphics data corresponding to the portion portions of the scene that lies lie 
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within the rectangular subvolumes to which the multiple graphics processing unit units 
have been assigned (Figure 6 204 "section memory 204 is used to store sections of a 
volume during rendering of the volume data set by the VRC", column 14, line 47-48 and 
Fig. 10 depicts loading of the subvolume to memory). 

8. As per claim 4, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 3, and Kaufman further discloses wherein said combining further 
comprises the step of 

(5) ordering said rendered set of three-dimensional computer graphics data 
based on locations between said determined viewing position and the rectangular 
subvolumes to which the multiple graphics processing units have been assigned (Figure 
1, item 6; "The conveyer 10 performs a deskewing operation in order to match the 
physical sequential order of the input modules of the ray projection tree 6 to the 
sequential order of the voxels of each viewing ray", column 2, line 3-6). 

Thus, it would have been obvious to one of ordinary skill in the art to incorporate 
the teaching of Kaufman into Knittel because Knittel discloses a method of presenting 
three-dimensional computer graphics and Kaufman discloses the image is combined in 
sequential order in order to generate a three-dimensional image related to a projection 
array. 

9. As per claim 5, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 3, and Knittel further discloses combining further comprises the 
step of: 
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(5) blending said rendered set of three-dimensional computer graphics data 
(Figure 4 29 "a compositing unit 124 that mathematically combines the sample values 
into pixels depicting the resulting image 32", column 9, line 36-39). 

10. As per claim 7, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 3, and Knittel further discloses wherein each of the image 
combiners has an associated frame buffer for storing said combined three-dimensional 
computer graphics image (Figure 14, item 200 where the pixel memory stores said 
combined three-dimensional computer graphics image). 

11. As per claim 9, Knittel discloses a system for presenting three-dimensional 
computer graphics images, comprising: 

memory for storing a set of three-dimensional computer graphics data (Figure 14, 
item 100); 

multiple graphics processing units for rendering substantially all of the set of 
three-dimensional computer graphics data, rather than a sample o the set of three- 
dimensional computer graphics, that corresponds to substantially all of a scene that lies 
within rectangular subvolumes to which said multiple graphics processing units are 
assigned (Figure 7 V-Bus to 210 "The VRC 202 includes a pipelined processing 
element 210 having 4 parallel rendering pipelines 212 ... The processing element 210 
obtains voxel data from the voxel memory 100 via voxel memory interface logic 216", 
column 14, line 61-63, where the rendering pipelines are considered multiple graphics 
processing units); 
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a bus for communicating a viewing position to each of said multiple graphics 
processing units, wherein the viewing position determines an aspect of the set of three- 
dimensional computer graphics data to be rendered ("A first interpolation unit 244 
interpolates the z-gradient in the z direction, resulting in four intermediate values", 
column 12, line 64-66, therefore, the viewing direction is known by the GPU); and 

image combiners for combining the set of three-dimensional computer graphics 
data rendered by said multiple graphics processing units to produce a three- 
dimensional computer graphics image (Figure 14 has a plurality of Compositing Unit), 
wherein outputs from the multiple graphics processing units are direct inputs to first 
stage image combiners and outputs from at least two of the first stage image combiners 
are direct inputs to a second stage image combiner. 

Knittel discloses a system for presenting three-dimensional computer graphics 
images using multiple graphics processing units. It is noted that Knittel does not 
explicitly disclose "outputs from the multiple graphics processing units are direct inputs 
to first stage image combiners and outputs from at least two of the first stage image 
combiners are direct inputs to a second stage image combiner, thereby producing a 
three-dimensional computer graphics image", however, this is known in the art as taught 
by Kaufman. Kaufman discloses a system of volume visualization in which the voxel 
data is combined hierarchically (Figure 6 where voxel combination unit 38 is considered 
an image combiner and a voxel is considered a subvolume of a image). 

Thus, it would have been obvious to one of ordinary skill in the art to incorporate 
the teaching of Kaufman into Knittel because Knittel discloses a system of presenting 
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three-dimensional computer graphics and Kaufman discloses the image is combined in 
several stages in order to quickly generate a three-dimensional image. 

12. As per claim 10, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 9, and Knittel further discloses said memory comprises memory 
cells such that each of said memory cells is accessible by only one of the multiple 
graphics processing units ("The voxels are supplied to the pipelines 210-0- 212-3, 
respectively, in 4-voxel groups in a scanned order", column 15, line 9-11). 

Response to Arguments 

13. Applicant's arguments filed 9/5/2006 have been fully considered but they are not 
persuasive. 

Applicant alleges Knittel or Kaufman do not teach rendering ... "substantially all 
of said allocated set" of . .. graphics data, rather than a sample of the set of three- 
dimensional computer graphics data. In reply, Examiner considers a sample of the set 
of data (as taught by Knittel and Kaufman) can be interpreted as "substantially all of 
said allocated set" of data, or even as "allocated data". Knittel reference is a more 
complicated version of the claimed invention which covers the claimed invention. 

Conclusion 

15. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 

time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
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mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 



16. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ryan R. Yang whose telephone number is (571) 272- 
7666. The examiner can normally be reached on M-F 8:30AM-5:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi can be reached on (571) 272-7664. The fax phone number 
for the organization where this application or proceeding is assigned is (571) 273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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